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ABSTRACT 

The results obtained by three test adoinistration 
^modes were ^xamined with a focus upon systematic bias due to lack of 
standardization of test administration procedures. The My Class 

'.Inventory was administered to ninety classrooms of fifth grade- 

* students in a large suburban school district. The ^5 items oil the 
inventory are distributed over five factors: satisfaction^ friction^ 
coptpet itiveness, difficulty^ and cohesiveness. The test was 
administered in thi^ee ways: (1) by the teacher; (2) by outside test • 
ad-mini strators ; and '(3) by children, using pre-recorded tape 
cassettes. * Sig-nificant differences were found for factors of 

• Satisfaction^" friction, and cohesiveness , but there were no 
significant differences among- methods on coapetdtiveness and 
difficulty^ There were factor differejices and overall differences 
between .teacher administered a'nd the ether techniques. There 'were no 
-significant differences between putside administrator and the student 
cassette tape method. Student tape cassettes were the preferred 
technique because they minimized teacher bias, were inexpensive, and 
standardized directions and procedures. Besults also indicated that 

^ the pre-recorded taped directions, administered -by students more 
clase3.7 approximated the results obtained by an' o'jatside evaluator 
th^n di'd the results obtained by teacher administration of the same 
instrument. (Author/JAC) . - 
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Standardization of test administration procedures and 
control of systematic bias in test score results is frequently 
assumed in attitude measurement. This assumption is becoming 
an increasingly crucial issue in the research context of using 
attitude mfeasores as an integral part of school evaluation 
studies. While numerous instruments have been developed which 
purport^ to measure children's attitudes toward various aspects 
of the educational system, few eva^ators have taken ixi±X),. con- 
sideration aspects of psychometrize testing theory other than 
reliability and validity'. It is ^eo often simply assumed that 
testing procedures are either standardized or will not" effect 
re^sults. It is with this latter assumption that many questions 
can arise. 

The realities of the test situation and the prpcedures 
of test administration can, and often do, bias test results. 
Many times, teachers are asked to adjninister instruments within 
their own^ classrooms with few attempts being made to standard- 
ize the, administration procedure or to impress upon the teacher 
the [)ossibility that he or she may in%|.uence the children's 
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resp'onsgs. In an attitude tpward school measure, the teacher 
and the setting which is being measured is an overwhelming ^ 
reality which continually surrounds and effects the- child's 
life. How can a child respond negati^rely to a question such 
as "I like my teacher" if that teacher is administering .tVie 
tost? Toachr^rs can .and do influence responses with such be- 
haviors as frowns and glancing at papers, or making ccfmments 
such as "I hope you an^swer dll the questions correctlyl" 

- There are at least two 'alternative methods which could 
be employed to administer attitude toward school measures 
that would Vend to negate the effects of teacher bias from ^ 
a childVs test responses. First, an outside test adminis- 
trator could be utilized. This, however, is costly to the 
school in terms of time and money. An outside evaluator 
would ha\>e to be hired and trained. An elaborate scheme 
must then^ be arranged to coordinate the testing schedule. 
Arrangements for giving the tests within each individual 
classroom would have to be made. 

A second alternative i-s to allow the chi Idren themselves 
to administer the attitude measure. While this could be 
•accomplished in several ways, it would seem that an addi,- 
tional decjree, of standardization would be achie-'^e^ if the 
tost directions were pre-recorded on a tape- cassette . The 
tost- [)apers could 'then be packaged with the cassette record- 

4 

uncj an^l written instructions for the children. - The children 
wou](l play ;the tape and follow its direction/. Additionally, 
th(^ toacho^r would nreed to leave' the room^so^ that the children 
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would feel free to respond in an open manner. At-the end of 
the testing period, the children would then be asked to return 
the completed test f\apers to the package, seal it, and return 
it to^ a central pickup point. 

The three t'est administration procedures described above 
.were used' in, a research" study to determine if one method of 
administration would produce statistically different test 
score results. The type of test administration used in 
the research was: (1) teacher administered, (2) outside eval- 
uator adfninistered , and (3) student administered with a tape 
cassette recording. 

The population sa^^ple consisted of approximately 75 
classrooms of fifth grade children in a large suburban school 
district. All of the children who were included in the sample 
were white, middle-class, regular public school students in 
the fifth grade. This homogeneous sample was used in order 
to further minimize differences which might occur in a test 
population. ^ . , * 

The classrooms were randomly divided into three groups. 
Group 1 had the test administered by their respective teach- 
ers, group 2 had the test administered by an outside evaluator, 
and group 3 administered the test to themselves u^ing tape 
cassette directions . 

The attitude test us^d in 'the research was the My Class 
Inventory developed by Gary J. Anderson. ^his measure was. 
-.developed for use with eight to twelve-year old children. 
Each child is asked to agree or disagree to forty-five test * 
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items such as "The class is fun" and "Only the smart people' 
can do the work in^ our class.'* 

The forty-five items are distributed over five factors: 
(1) Satisfactign, (2) Friction, (3) Competitiveness, (4) Diffi- 
cdlty, and (5) Cohesiveness . The reported factor reliabilities 
range from .54 to ^77. A factor analysis of this population 
produced parallel factors to the reported factors. The indi- 
vidual reliabilities, corrected for attenuation, on this 
sample ranged from -.54 to.. 79. . 

Mean scpr'es and standard deviation for each factor and 
the total score are presented by group in Table I. - 

? 

TABLE I 

if 

MEANS AND STANDARD DEVIATION'S OF FACTORS AfJD TOTAL 





Group 1 


(n=23) 


Group 2 


(n=25) 


Group 3 


(n=24) 


Factor 


M 


6 


M 


6 


M» 


6 


. 1 


20.2 


5.1 


18.9 


4.9 


, 18.9 


5'.. 3 


2 


19.4 


3.5 


20.3 


3.7 


19.9 


3.9 


3 


20.1 


3.7 


21.2 


3.4 


21.2^ 


3.6 




14 .8 


3.5 


14.9 




14.7 


3.4 


. 5 


20.4 


3.3 ^ 


19. .7 


3.3 


1''9'. 8 


3.5 


TQ±al 


96.0 


6.9 
1 


9.5.0 


' 7.1 


94.6 


7.6 



,^ A one-way analysis of variance was used to deterirune 
if there was a difference between administration groups. A 
Fisher/ s t-tcst for independent sample was used for multiple 
compari^bns as needed. 'The results of this analysis appear 
' i n Table M . ' ' - " 

** ' * 
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TABLE II 



RESULTS OP ONE-WAY ANALYSIS OF VARIANCE 
BETWEEN ADMINISTRATIVE GROUPS 



Factor 


F 


t for 1,2 


^1,3 


2,3 


Satisfaction 


13.90* 


4.73* 


4.39* 


0.25 


Friction 


9.41* 


-4. 33* 


-2. 38* 


1.90 


Competiveness 


0.15 


N/A 


N/A- 


N/A 


Difficulty 


0.47 


- N/A 


N/A 


N/A 


Cohesiveness 


^6.66* 


3.40* 


2. 86* 


-0.47 



Total Score 5.23* 2.25* 3.14* 0-94^ 

*p .05 df=2,1822 » 

There were statistically significant differences on thre 
of the tx^e factors. On the factors of Satisfaction, Frictic^n' 
and Cohesiveness, the differences were between the teacher 
administered method and both outside evaluator and tape admin- 
istered methods. There were no differences amCng methods on 
Competitiveness arjd Difficulty. 

By inspecting the means presented in Table -I, it can be 
seen that the mean for the Satisfaction factor was, higher than 
for the other two methods. The Friction factor has a mean 
Ipwor on the teacher administered method than bn the other 
methods. On the Cohesiveness factor, the mean for the te^acher 
administered method is again higher. 

For the overall total scores, the differe^nces were between 
tliG teacher administered methods and both the outside administered 
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method and the tape administered method. The teacher 
administered method had a higher overall 'mean score. There . 
was no statistical difference between the outside evaluator 
method and the tape administered method. 

\ 

Given the choice of preferable methods of administration, 
it seems that the method of tape recorded administration has 
several advantages for l^e educational evaluator. First, it 
can minimize teacher bias* The teacher is not present during 
the testing and should not handle the test package. Both 
verbal and nonverbal communiGTation by the teacher can be 
controlled in this manner. 

Secondly, the tape method is inexpensive. * One person ' 
records the directions and then the recording i\s duplicated. 
Test packets are compiled and can be distributed through 
school district postal systems. ' When the te^tiog ; is' over , 
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tapes can be erased and used again, ^ ^ » ^ 

Lastly, the^ tape method standardizes the directions and 
procedures . All the chi Idren responding to any one instrument 
receive exactly the sam'e dir^ections and follow the same proce- 
dures. Classroom' groups using the tape administratibn method 
^follow the procedure in the same amount of time and with a 

minimum amount of class dis-ruption as compared to the other" 

^ 

two groups. 

Basod upon the findings cited above, it would seem that 

the conclusion could be drawn that the tape administration 

method IS an effective means of achieving standardization in 
admini stration and reduction of systematic teacher bias in 
attitude measurement related to educational settings, 
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